Introductory Remarks
In a nutshell the processes of Program Evaluation can be described as follows: 1. Describing the Object This initial phase is one in which the object of the evaluation identified, described and understood by all participants in the program and in the study. It is necessary to understand exactly what is being evaluated by being able to describe its characteristics, its limits the environment within which it exists. 2. Determining the Questions The second phase involves exploration of the evaluative questions to be answered by the study. This phase is typified by consideration of the purposes of the object, the purposes of the study and future considerations given the answers to the evaluative questions. It is at this point that a decision needs to be reached in terms of the value of the evaluation study. If the questions to be answered are of a crucial nature and can be answered by the study then the study proceeds. If the only questions surfaced are trivial or have obvious answers then the decision should be made to not enter into the study. 3. Establishing the Design The third phase of an evaluation study occurs when the design of the study is determined. There are a multitude of designs, approaches, frameworks, from which to choose. This is a technical decision which must take into account all of the considerations mentioned above as well as the structure of the surrounding organization, resources available and willing to participate, time lines and the accessibility of data sources. 4. Collecting and analyzing the Data Once the design has been established data sources need to be identified and data collection strategies need to be determined, devised, tested and ultimately used to collect the data necessary to answer the evaluative questions. 5. Writing the Report These data must then be analyzed, synthesized and used to construct the final evaluation report. This analysis usually includes a comparison with expectations or commitments made by the program. It is at this point that conclusions can be drawn concerning the program in relation to the questions identified in the early part of the process and recommendations for further action can be made.
The chapters you are to read for this session deal with the collection and reporting of the data. Poorly collected data and/or poorly analysed/understood data will doom any kind of Program Evaluation. This is a crucial segment of the evaluation process.
The reporting aspect is the public face of Program Evaluations. The final report must be complete, clear and accessible to appropriate stakeholder.
The last chapter in this session, Chapter 17, deals with the political and interpersonal aspects of Program Evaluation. This is a difficult area given that a great deal of evaluation activity has political motivations. The recommended readings have some interesting perspectives on these topics.
Required Readings and Assignments
The required reading for Session Eight consists of Chapters 15, 16 and 17 of the Fitzpatrick, Sanders and Worthen text.
The assignment for Session Eight is to follow the instructions given in the Chapter/Readings Review assignment. The deadline date is June 1, 2009.
I have adjusted the Related Article/Discussion Question Assignment. You are now only required to make two rather than three submissions. The deadline dates are: June 3 and June 8. Early submissions are always appreciated
Introductory Remarks
In a nutshell the processes of Program Evaluation can be described as follows:
1. Describing the Object
This initial phase is one in which the object of the evaluation identified, described and understood by all participants in the program and in the study. It is necessary to understand exactly what is being evaluated by being able to describe its characteristics, its limits the environment within which it exists.
2. Determining the Questions
The second phase involves exploration of the evaluative questions to be answered by the study. This phase is typified by consideration of the purposes of the object, the purposes of the study and future considerations given the answers to the evaluative questions. It is at this point that a decision needs to be reached in terms of the value of the evaluation study. If the questions to be answered are of a crucial nature and can be answered by the study then the study proceeds. If the only questions surfaced are trivial or have obvious answers then the decision should be made to not enter into the study.
3. Establishing the Design
The third phase of an evaluation study occurs when the design of the study is determined. There are a multitude of designs, approaches, frameworks, from which to choose. This is a technical decision which must take into account all of the considerations mentioned above as well as the structure of the surrounding organization, resources available and willing to participate, time lines and the accessibility of data sources.
4. Collecting and analyzing the Data
Once the design has been established data sources need to be identified and data collection strategies need to be determined, devised, tested and ultimately used to collect the data necessary to answer the evaluative questions.
5. Writing the Report
These data must then be analyzed, synthesized and used to construct the final evaluation report. This analysis usually includes a comparison with expectations or commitments made by the program. It is at this point that conclusions can be drawn concerning the program in relation to the questions identified in the early part of the process and recommendations for further action can be made.
The chapters you are to read for this session deal with the collection and reporting of the data. Poorly collected data and/or poorly analysed/understood data will doom any kind of Program Evaluation. This is a crucial segment of the evaluation process.
The reporting aspect is the public face of Program Evaluations. The final report must be complete, clear and accessible to appropriate stakeholder.
The last chapter in this session, Chapter 17, deals with the political and interpersonal aspects of Program Evaluation. This is a difficult area given that a great deal of evaluation activity has political motivations. The recommended readings have some interesting perspectives on these topics.
Required Readings and Assignments
The required reading for Session Eight consists of Chapters 15, 16 and 17 of the Fitzpatrick, Sanders and Worthen text.
The assignment for Session Eight is to follow the instructions given in the Chapter/Readings Review assignment. The deadline date is June 1, 2009.
Recommended Readings
IMPORTANT NOTE
I have adjusted the Related Article/Discussion Question Assignment. You are now only required to make two rather than three submissions. The deadline dates are: June 3 and June 8. Early submissions are always appreciated